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File: PGPB 



Mar 18, 2004 



DOCUMENT- IDENTIFIER : US 20040054690 Al 

TITLE: Modeling and using computer resources over a heterogeneous distributed network using 
semantic ontologies 

Current US Classification, US Primary Class/Subclass : 
707/104. 1 

Summary of Invention Paragraph : 

[0045] In further accordance with this disclosed system, a metadata component operative to 
control the accessing by the search component as a function of user context and/or application 
may be provided. The metadata component may be operative to apply constraints to search results 
based on user authentication. 

Summary of Invention Paragraph : 

[0056] A system according to this aspect of the invention may include a metadata component 
operative to control the accessing by the search component as a function of user context and/or 
application. The metadata component is operative to apply constraints to search results based 
on user authentication. 

Detail Description Paragraph : 

[0177] Still referring to FIG. 3, an ontology management system typically includes, but is not 
limited to, the following components: a semantic broker 320, an interpretation component 322, a 
semantic cache 330, and an ontology composer module 420. The semantic broker 320 includes 
functionality for (i) creating, editing, updating and deleting ontologies and concepts, (ii) 
creating models of computer resources through population of structural ontologies based on 
computer resource characteristics, and (iii) registering, storing and accessing ontologies. The 
semantic cache 330 is used to increase the efficiency of ontology queries. Any conventional 
cache capable of caching XML object query results may be used with the present invention. Those 
skilled in the art are familiar with the use of a cache. The ontology store 140 is a memory 
device for storing an ontology. 

Detail Description Paragraph : 

[0181] Turning now to FIG. 4, a detailed view 400, in block diagram format, of the various 
subsystems, of a second, preferred aspect of the exemplary computer resources management system 
110 from FIG. 1 is illustrated. Each function block in FIG. 4 represents portion, modules, and 
components of the second aspect of the overall computer resources management system 110. FIG. 4 
further includes communication flow lines between the various components illustrated. It should 
be further understood that the components/modules illustrated in FIG. 4 are implemented as 
computer program software modules or routines that execute on a computer system that is 
provided for carrying out the tasks of the computer resource management system 110 as described 
herein. Those skilled in the art will understand that the preferred method for carrying out 
many, if not all, of the functional tasks provided for in the disclosed system may be 
implemented as computer software running in a network environment with a physical architecture 
of multiple computer processors configured to operate with a conventional computer operating 
system, and may be deployed on a J2EE-compliant application server, such as IBM Websphere, BEA 
Weblogic, or the opensource JBOSS . The application server environment provides general 
transaction management including failover, load balancing, and error handling. Unless stated 
otherwise, components identified in FIG. 4, which have the same name (but different reference 
numerals) as components previously identified in FIGS. 1, 2, or 3, are intended to have the 
same or similar characteristics to the comparable components in such previous FIGS. 

Detail Description Paragraph : 

[0192] The metadata component 455 intentionally limits the functionality of the search 
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component 457 by controlling access to the search module 457 or filtering results returned by 
the search module 457, as a function of the context of the user or application (e.g. only 
providing search results for what the user or application is interested or permitted to see). 

Detail Description Paragraph : 

[0204] Each of these web services is assumed to be described and classified according to 
certain criteria. In the present example the web services are classified based on criteria of 
"cost," "quality," and "availability." Of course, many other objective and subjective 
attributes or characteristics may be associated with the various web services. But for purposes 
of the present discussion, only these three will be referenced. In this example, "cost" and 
"quality" are assumed to exist on a numeric scale from 0-10, and each of the particular web 
services has been assigned a "cost" or "quality" level that will be useful as this discussion 
example unfolds. In practice, the business entity associated with the system user 151 may 
utilize extensive classification criteria for defining and describing the web service. In 
accordance with the present invention, these additional attributes are considered meta-data, 
which are incorporated into the system as part of the web service classification ontology, 
discussed in greater detail hereinafter. 

Detail Description Paragraph : 

[0207] At Step 721 the system user 151 classifies the web service and describes basic 
characteristics, from the viewpoint of the system, that will index and classify the system. An 
example of such indices include whether the web service is private or publicly-accessible and, 
if private, what ID-password combination is required to invoke the web service. The system user 
151 may provide additional information describing the web service and/or its attributes, 
characteristics, features, quality, and other objective or subjective information that may not 
be revealed by the web service itself or that may be pertinent to the particular business 
entity or entities that invoke the web service. The end result of providing such additional 
information is providing specific attributes for classifying the web service through the 
creation of meta data that populates an instance of the web services classification ontology 
732 and is stored in the ontology store 140 in conjunction with the corresponding web service 
structural ontology 730 for this web service. A specific web service classification ontology 
consistent with the present example will be described in connection with FIG. 13B. 

Detail Description Paragraph : 

[0225] In evidence in the XML schemas are the structural characteristics of the description 
logics of DAML as an exemplar of ontologies. Illustrated in the present example are class, sub- 
class, objectproperty, resource, and ID. Classes are groups of objects that have similar 
characteristics . Subclasses inherit the characteristics of the classes but reflect a limited 
sub-set of properties. Ob j ectproperties are themselves classes and define class properties and 
relationships. These are predicate relationships in the subject-predicate-object structure. 
Resources are things described by RDF expressions (e.g., web pages, part of a web page, 
collections of web pages, objects not directly accessible via the web) named by a URI or 
optional anchors or identifiers. ID describes a specific type of a class. 

Detail Description Paragraph : 

[0234] By way of example and not limitation, Service 1110 has a number of descriptive 
properties (objects) illustrated. In other words, Service 1110 is classified by Cost 1112, 
Quality 1114, and Availability 1116. It should be understood that many additional and potential 
properties (not shown) could have been included to provide even more detail in describing 
relevant properties (such as "convenience," dependability," and the like) that a Service 1110 
may have and that may serve as classification criteria, indices, further characteristics, or 
characterizations of the Service 1110. It should also be noted that both Cost 1112 and Quality 
1114 have been defined to have a rating expressed as an Integer 1118. Conversely, Availability 
1116 has been defined to have a rating expressed as three possible "word" values: Always 1120, 
Periodically 1122, and Seldom 1124. As will be appreciated by one skilled in the art, the range 
of possible properties for Cost, Quality, and Availability is arbitrary and innumerable. For 
example, Cost could have been defined to have possible values of "Expensive," Moderate," and 
Cheap;" Quality could have been defined to have possible values of "4 Star," "3 Star," "2 Star" 
or "1 Star;" and Availability could have defined to have an integer value or to have other 
possible values, such as "Business Hours," "Weekends," and "24/7." Finally, ontology 1100 
illustrates that Service 1110 is a "subclass of" Service 950 (defined previously in FIG. 9) . 
This makes clear that this classification ontology will be applicable to any web service 
structural ontology defined in FIGS. 9 and 10. 
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Detail Description Paragraph : 

[0287] FIG. 29 illustrates a third semantic mark-up display screen 2900 that shows a list of 
available business information model ontologies in field 2920 that are available for 
association with the previously-selected web service. The available business information model 
ontologies are displayed after entering appropriate search criteria in fields 2930 or 2940 and 
selecting the browse button 2910. A selected business information model, such as the "airline 
ontology" (i.e., "airline reservation schema"), is selected for further operations as described 
in greater detail below. 

Detail Description Paragraph : 

[0304] First, the system user 151 initiates a search based on particular concepts and search 
parameters, using the vernacular that the system user believes may result in retrieving the web 
services that the system user desires to mark up. The system user inputs certain parameters 
that are passed to the mark-up module 444 (using a display screen such as that shown in FIG.* 
27), which in turn provides these parameters to the search module 457. The search module 457 is 
responsive to pass a message to the metadata service 455 to retrieve the system user's 
"context." The user context identifies what web services the user is entitled (or not entitled) 
to receive, access and mark-up and what web services are relevant (or not relevant) to the 
particular system user in response to the search request. Such context information is returned 
by the metadata service 455 to the search module 457. The search module applies the user 
context information to filter the search criteria, which search is then run against the 
resource registry 142 to identify relevant web services. The list of web services identified by 
the search is returned to the mark-up component 444 (and displayed to the user, for example, as 
shown in field 2720 of FIG. 27). After the user selects the desired web service, the instance 
data contained in the web service structural ontology for the service is returned to the Markup 
module 444. The user selects a desired method or operation provided by the web service for mark 
up (see e.g. FIG. 28) . 

Detail Description Paragraph : 

[0305] The next step taken is the location of applicable business information model ontologies 
for association with the selected web service ontology. The mark up component 444 communicates 
with the Atlas 442, which responds by querying the ontology store 140 to retrieve any pre- 
stored business information models that may be relevant for association with the ontological 
model of the selected web service. The user's context is applicable in filtering, if necessary, 
what business information models are available to the system user and, thus, returned to the 
markup component 444. The user then associates properties of the ontological model of the web 
service with relevant concepts of the business information models to create a binding 
therebetween, as shown in FIGS, 30-31. If necessary, the markup component 444 requests 
transformation ontologies (see, e.g., FIGS. 32-33) from the Atlas 442, which in turn, queries 
the ontology store 140 for the same, which then responds by returning any appropriate 
transformation/mark up ontologies to the mark up component 444. After entering any applicable 
information necessary for associating the transformation ontology with the properties of the 
web service, the mark up component 444 sends such meta data to the Atlas 442, which writes the 
information to the ontology store 140. The mark up component 444 also registers the 
transformation ontology in the resource registry 142. If desired, the user is also able to 
specify default values (see FIG. 34) for any of the "input" properties of the web service. Once 
the user is finished configuring the association between the web service and the business 
information model (s), a SIM model is created. The mark up component 444 sends such SIM model to 
the Atlas 442, which writes the information to the ontology store 140. The mark up component 
444 also registers the SIM model in the resource registry 142 and meta-data is bound to the 
model to create classification information. Classification information may include such 
information as when and how the SIM model should be used. Specifically, relevant business 
contexts, such as business processes or integration efforts, for defining the web service may 
be defined. 

Detail Description Paragraph : 

[0306] FIG. 42 illustrates the execution modeling process wherein a system or end user 151,126, 
respectively, retrieves pre-stored business information models (or concepts), configures and 
inputs parameters for invoking the same, and combines, assembles, or chains multiple such 
business information models or concepts to create a complex computing task. In particular, the 
user initiates the execution modeling process by launching the model editor component 425. The 
user then enters any desired search terms into a search display screen. The model editor 425 
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passes the search terms to the Atlas 442, which responds by retrieving any appropriate user 
context from the metadata service 455, which, in turn, returns any applicable user context 
information, such as access privileges to the particular business information models and 
ontology concepts. 

Detail Description Paragraph : 

[0307] The Atlas component 442 uses the user context information to construct an appropriate 
query to the ontology store 140, limited by any applicable user context information provided by 
the metadata 455. Any retrieved business information models or ontology concepts are returned 
in the form of the ontologies (and concepts) that will be available to the user for creation of 
an execution model. Once the user has retrieved all desired business information models and 
concepts (after one or multiple searches), the user proceeds to the model editor graphical 
display screens, such as those shown in FIGS. 35-37, to configure an execution model. Upon 
completion of any edits to the execution model, the model editor 425 "sets" or "saves" the 
execution model by communicating with the Atlas 442, which writes the model to the ontology 
store 140. The model editor 425 also registers the execution model in the resource registry 
142. During the registration of the execution model, the user binds meta-data to the execution 
model instance which provides index and classification information to assist in model 
discovery. Further, the registration process creates a unique identifier for the model so that 
the model can be invoked at a future time by a system 128 or system user 151 who passes the 
model identifier as a parameter. Thereafter, the created or edited execution model ontology is 
available for further utilization by others, or further access by the user. 

Detail Description Paragraph : 

[0309] To perform the "discovery process," the interpretation module 422 forwards the execution 
model to the mark up component 444, which queries the Atlas 442 to find and retrieve web 
service ontologies from the ontology store 140 that have been associated, through the mark up 
process, with the relevant business information models. Specifically, the mark-up component 444 
creates queries of relevant SIM models to determine the associations between the business 
information models and the web service ontologies. Web service ontologies that meet the 
constraints specified in the execution models will be identified based on information contained 
in the SIM models. The Atlas 442 then communicates with the inference module 450, which 
compares the parameters and restrictions requested by the user with the characteristics and 
classifications of each potential web service (see, e.g., discussion associated with FIG. 39). 
Once a "best" web service ontology has been identified by the inference module 450, such 
information is returned and provided to the interpretation module 422 to apply any necessary 
transformation ontologies to the information ' and parameters input as part of the execution 
model and as applicable to the web service identified by the inference module 450. The 
interpretation module 422 then forwards the execution model, with relevant transformation 
ontologies, to the execution model 430 (see FIG. 45) . 

Detail Description Paragraph : 

[0311] The public service 415 communicates with the interpretation module 422, which "holds" 
the execution model until the "discovery process" has been completed. To perform the "discovery 
process, " the interpretation module 422 forwards the execution model to the mark up component 
444, which queries the Atlas 442 to find and retrieve web services ontologies from the ontology 
store 140 that have been associated, through the mark up process, with the relevant business 
information models. This is accomplished through queries of the SIM models. The Atlas 442 then 
communicates with the inference module 450, which compares the parameters and restrictions 
requested by the user with the characteristics and classifications of each potential web 
service. Once a "best" web service ontology has been identified by the inference module 450, 
such information is returned and provided to the interpretation module 422 to apply any 
necessary transformation ontologies to the information and parameters input as part of the 
execution model and as applicable to the web service identified by the inference module 450. 
The interpretation module 422 then forwards the execution model, with relevant transformation 
ontologies, to the execution model 430 (see FIG. 45) . 

Previous Doc Next Doc Go to Doc# 



http://westbrs:9000toin^^ 3/29/05 



Record Display Form Pa 8 e 1 of 8 

First Hit Previous Doc Next Doc Go to Doc# 

End of Result Set 



L5: Entry 2 of 2 



File: PGPB Jul 4, 2002 



DOCUMENT-IDENTIFIER: US 20020087525 Al 

TITLE: Soliciting information based on a computer user's context 
Abstract Paragraph : 

A user search request is received and context information for the user is identified. The user 
search request and the context information are then combined to generate search c riteria 
corresponding to the user search request, providing for information solicitation based on a 
computer user's context . 

Current US Classification, US Primary Class/Subclass : 
707/3 

Summary of Invention Paragraph : 

[0002] This disclosure relates generally to computer-assisted solicitation of desired 
information, and more particularly to soliciting information based on a computer user's 
context . 

Summary of Invention Paragraph : 

[0008] Soliciting information based on a computer user's context is described wherein. 
Summary of Invention Paragraph : 

[0009] According to one aspect, a user search request is received and context information for 
the user is identified. The user search request and the context information are then combined 
to generate search criteria corresponding to the user search request. The context information 
includes, for example, information regarding one or more of: the user's physical environment, 
the user's mental is environment, the user's computing environment, and the user's data 
environment. 

Summary of Invention Paragraph : 

[0010] According to another aspect, a product interest characterization (PIC) is generated that 
includes multiple fields, some fields being populated with user-defined 'data inputs and other 
fields being populated with automatically-generated user context information. The generated PIC 
is then communicated to one or more information sources where the PIC is compared with 
information at these sources to identify content that matches the parameters in the various 
.fields of the PIC. The matching content is then presented to the user. 

Brief Description of Drawings Paragraph : 

[0014] FIG. 4 is a flowchart illustrating an exemplary process for soliciting information based 
at least in part on the user's context . 

Detail Description Paragraph : 

[0020] This disclosure describes soliciting information for a user based at least in part on 
the user's context . Search parameters or other data associated with a user's search request is 
combined with context information for the user to generate search criteria . The search criteria 
can then be compared with data (stored locally and/or remotely) to identify information that 
matches the search criteria . The user is able to solicit any of a wide variety of information, 
such as advertisements (e.g., of products or services), reference materials (e.g., electronic 
books or articles), as well as actual goods or products themselves (e.g., in electronic form 
(such as audio content that can be downloaded and played immediately), or for more traditional 
physical delivery (such as ordering a coat and having it shipped via an overnight shipping 
agent) ) . . 
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Detail Description Paragraph : 

[0034] A more detailed explanation of the CDOS system 120 may be found in a co-pending U.S. 
patent application Ser. No. 09/216,193, entitled "Method and System For Controlling 
Presentation of Information To a User Based On The User's Condition", which was filed Dec. 18, 
1998, and is commonly assigned to Tangis Corporation. The reader might also be interested in a 
more detailed discussion of context attributes (or condition variables) discussed in U.S. 
patent application Ser. No. 09/724,902, entitled "Dynamically Exchanging Computer User's 
Context", which was filed Nov. 28, 2000, and is commonly assigned to Tangis Corporation. These 
applications are hereby incorporated by reference. 

Detail Description Paragraph : 

[0035] An optional information solicitation manager 178 is also shown stored in memory 172 and 
executes on processing unit 170. Information solicitation manager 178 utilizes data from CDOS 
system 120 to generate search criteria based on the user's current environment. Alternatively, 
information solicitation manager 178 and CDOS system 120 may be implemented at a remote 
location (e.g., not in close physical proximity to the user 150). 

Detail Description Paragraph : 

[0038] User search requests are input to an information solicitation management component, 
which, in the illustrated example, is a product interest characterization (PIC) manager 212. 
PIC manager 212 receives the user request and combines the request with the user's current 
context from context awareness model 214 in order to generate search criteria . The generated 
search criteria is then communicated to the locally and/or remotely situated information source 
102. The search criteria is compared to the information at source 102 (e.g., an Internet search 
engine) to determine what information (if any) at source 102 matches the search criteria, and 
optionally how well that information matches the search criteria . The results of the comparison 
are then returned to PIC manager 212, which returns the results as appropriate to output device 
(s) 210 for presentation to the user. The results returned to PIC manager 212 may be sufficient 
to present to the user, or alternatively may only identify content that needs to be accessed by 
PIC manager 212 and presented to the user. For example, the results returned to PIC manager 212 
may be a set of uniform resource locators (URLs). Those URLs may be presented to the user, or 
alternatively PIC manager 212 may access the locations identified by those URLs and return the 
content at those locations for presentation to the user. 

Detail Description Paragraph : 

[0039] Context awareness model 214 maintains context information for the user, allowing a 
characterization module 216 to attempt to characterize the user's context (e.g.,. his or her 
current context at the time a user search request is made by the user and/or received by PIC 
manager 212) and communicate this context information to PIC manager 212. Context awareness 
model 214 is built based on input from various modules 218, 220, 222, and 224 that capture and 
pass information based on inputs from one or more sensors 226 (e.g., environment sensors 164, 
user sensors 162, etc. of FIG. 2) . Sensors 226 monitor the environment parameters and provide 
data to the modules 218-224, and can be local to the user and/or remote from the user. Sensors 
226 can be any transducer or software module that provides data used (or potentially used) in 
the context awareness model 214. 

Detail Description Paragraph : 

[0040] In the illustrated implementation, the context awareness model 214 gathers information 
on (1) the user's physical environment from module 218, (2) the user's mental environment from 
module 220, (3) the user's computing environment from module 222, and (4) the user's data 
environment from module 224. 

Detail Description Paragraph : 

[0041] Physical environment module 218 generates information pertaining to the user's present 
location (e.g., geographical, relative to a structure such as a building, etc.), the current 
time, and surrounding objects that may be used as a basis for searching. As an example of this 
latter situation, a user with a wearable computer may be traversing through a mall having 
numerous stores therein. While in this location, the user may request product sale information 
and only advertisements of products sold in stores in the mall and currently on sale are 
presented to the user. 

Detail Description Paragraph : 

[0042] The mental environment module 220 generates information pertaining to the user's likely 
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intentions, their preferences, and their current attention. For instance, the mental 
environment module 220 may use data from a pupil tracking sensor or head orientation sensor to 
identify a direction or object on which the user is focused. If the user appears to be focused 
on administrative items presented on the heads up display, then the user context module 220 
might determine that it is safe to present search results. 

Detail Description Paragraph : 

[0044] The search criteria generated by PIC manager 212 is encapsulated in a data structure 
referred to as a PIC. A PIC is the data that is sent from the consumer computing system (e.g., 
PIC manager 212) to information sources 102. If the information provider determines that there 
is content that sufficiently conforms to the consumer's interest (e.g., matches all of the 
search criteria, or at least a threshold amount of the search criteria ) , an indication of a 
match, optionally with product description information and other commerce facilitating code and 
data, can be sent to the consumer. 

Detail Description Paragraph : 

[0046] PIC manager 212 is thus able to formulate search criteria (e.g., in the form of PICs) 
encompassing a wide variety of different information. This can include, for example, basic 
keyword inputs by the user which are then combined with other formation (e.g., from context 
awareness model 214) by PIC manager 212 to formulate the search criteria . 

Detail Description Paragraph : 

[0047] FIG. 4 is a flowchart illustrating an exemplary process for soliciting information based 
at least in part on the user's context . The process of FIG. 4 is performed by, for example, PIC 
manager 212 of FIG. 3, and may be implemented in software. 

Detail Description Paragraph : 

[0048] Initially, user input is received (act 252) . The current user context is then identified 
(act 254), and search criteria (e.g., a PIC) generated based on both the received user input 
and the identified user context (act 256) . A search is then performed for information that 
satisfies the search criteria (act 258). The search may be performed by the component that 
generates the search criteria (in act 256) , or alternatively the search may be performed by 
communicating the search criteria to a search component (e.g., an information store .102 of FIG. 
3) . Once the search is at least partly completed, the search results are presented to the user 
(act 260) . Search results may be presented to the user as they are received by PIC manager 212, 
or alternatively after all searching has been completed. 

Detail Description Paragraph : 

[0049] One example of soliciting information involves the user passing (walking, riding, 
driving, etc.) a store and submitting an advertisement search request. The search criteria 
include the advertisement request as well as context information indicating that the user is in 
close proximity to the store. The search results include an advertisement that the store is 
selling a product (e.g., a specific brand of cigarettes, including cigarettes the user's 
context knows that the user has purchased in the past) for a price that the user may be willing 
to purchase the item (e.g., the cigarettes are on sale, or cheaper than other stores, or 
cheaper than the users last purchase of cigarettes). The cigarette advertisement is thus 
presented to the user. In general terms the user's context determines whether a particular 
criteria is met and presents an advertisement (in this case, generated by the store, but not 
directed at specific consumers) to the user. 

Detail Description Paragraph : 

[0062] New PIC data store 352 is used to generate a unique PIC. Data store 352 can contain 
different types of information, such as information provided by the user to characterize new 
information (e.g., a new product) of interest. Data store 352 may also include information 
previously provided by the user to characterize other information (e.g., product(s)) of 
interest. This information may be included because the user indicated a desire to have PICs 
with similar fields share values as default. Additionally, system-suggested information may 
also be included. For example, based on previous PICs, the system can suggest PIC fields and 
values based on previous user behavior. A more detailed explanation of such predictive behavior 

can be found in . a co-pending U.S. patent application Ser. No. , entitled "Thematic 

Response To A Computer User's Context, Such As By A Wearable Personal Computer" to James O. 

Robarts and Eric Matteson, which was filed , and is commonly assigned to Tangis 

Corporation. This application is hereby incorporated by reference. 
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Detail Description Paragraph : 

[0065] Generic product characterization data store 358 allows the user to rely on recognition 
rather than recall to create a PIC. This is valuable because the PIC fields required for the 
precise characterization of a product interest are significantly different for different types 
of products, and there are many of them, and they can change over time. Therefore, a 
generalized taxonomy of generic products is provided, that can be navigated (e.g., 
hierarchically, graphically with pseudo-spatial relationships, keyword searched, and so forth) 
similarly to actual product catalogs (e.g., online Yellow Pages). As the user traverses the 
data store, he or she can both be learning about general product characteristics (new luxury 
SUVs are available from which manufacturers, in a bounded price range), and providing candidate 
fields and values for the PIC Builder (for storage in data store 358). 



Detail Description Paragraph : 

[0068] Returning to FIG. 5, once a PIC is generated and made active by user 316, the PIC is 
made available to PIC sender 310 which distributes the PIC to one or more information sources 
302 and/or 304. One or more sending options for the PIC may also be identified by the user or 
automatically (e.g., based on the user's context ) . The sending options identify how, when, 
and/or where the PIC is sent. For example, the PIC may be saved until bandwidth is available, 
or collected in a set of PICs (e.g., perhaps purchases of products need to be coordinated: 
medication, scuba diving equipment, computer hardware & software) . Once the sending options 
have been indicated, the actual process of sending a PIC and receiving responses can be 
transparent to the user. The user may simply see the results of the query. 

Detail Description Paragraph : 

[0074] In addition, PIC receiver 312 may use the user context to determine how filters get 
applied to the content. For example, a user may generate a PIC for information about changing a 
flat tire. However, the search may take a long time and the results of the search may not be 
returned to PIC manager 212 until after the user has fixed the flat tire. In this situation, 
the appropriateness filter can filter out the search results and not have them presented to the 
user because based on the user context (the flat tiring having been fixed), the search results 
are no longer important to the user. 

Detail Description Paragraph : 

[0075] PIC receiver 312 (or alternatively presentation manager 314) may also communicate with 
context awareness model 214 or characterization module 216 of FIG. 3 to present information in 
an improved form. Context model 214 includes logic that describes functional and presentational 
characteristics of a desired UI for the current user context . This may include UI layout, 
selection of presentation surface, privacy, and so forth. 

Detail Description Paragraph : 

[0081] Immediately notify the user — notification can include terse message (a PIC has a match, 
a particular PIC has a match) or arbitrarily complex descriptions. Descriptions could scale to 
the entire correlation result (a composite value of strength of match, description of what 
characteristics do or do not match, source of product, supplemental information provided by PIC 
Broker including ID, recommendations or review of product or product provider, suggestions) . 

Detail Description Paragraph : 

[0084] Once generated, the PIC is communicated by PIC manager 452 to a PIC receiver 454 at PIC 
broker 450. The PICs 456 from this user, as well as other PICs 458 from other users, are made 
available to a correlation logic 460. Correlation logic compares the search criteria in the 
PICs 456 and 458 to multiple product characterizations 462(1), 462(2), 462(3), . . . , 462 (X) . 
Any of the product characterizations 462 that satisfy the search criteria are communicated to 
the product provider(s) 464 corresponding to the matching product characterization (s) , which in 
turn provide the corresponding product information (or the product itself) to the user 
computing resources 466 (e.g., a client 106 of. FIG. 2). Correlation logic 460 may also 
optionally provide the product characterizations 462 that satisfy the search criteria to the 
user computing resources 466. The product information or characterization received at resources 
466 may also be filtered by filter 468, which may prevent presentation of the information or 
characterization, or delay its presentation until an appropriate time. 

Detail Description Paragraph : 

[0086] Yet another example is a content aggregator. Much like. a PIC broker, content aggregators 
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can provide interfaces to their data stores compatible with the user's context model (or vice 
versa, any party can provide a dictionary and write the translation filter) . In this scenario 
very tight control on the product descriptions, including availability, can be provided, 
insuring timely and accurate product offers. There can also be cooperation between different 
user models. For example, a variety of affinity mechanisms may be used which suggest products 
that are similar to the ones requested. The user's context models can directly, or thru the PIC 
Manager mechanism, indicate if this type of information is desired. The models can also 
cooperate by sharing the user's desire to have products having a high-correlation (clearly 
satisfying the PIC) be automatically purchased. Necessary information for purchase can also be 
exchanged securely. 

Detail Description Paragraph : 

[0089] Various aspects of the solicitation of information described herein can be seen from the 
following examples. A first example is the purchase of a child car seat. Assume that a user has 
a computer that maintains an explicit, extensible, dynamic model of his or her context. The 
user has used this model to maintain a data store of personal, detailed, private information, 
as well as information that is shared with others and available publicly. He or she is about to 
become a first time parent, and wishes to purchase a car seat for the new infant, but does not 
have familiarity with car seats and does not have a. lot of time for research. Further, he or 
she understands that there are likely trade-offs between product characteristics such as price 
and safety. 

Detail Description Table CWU : 

1 TABLE I Infor- mation Description Keywords A distillation of desired information (e.g., 
product characteristics ) . Keywords are typically chosen for brevity and precision, and can 
serve as search terms for many of the currently available Internet search engines. Context 
Contain any data (e.g., name/value pair(s)) characterizing the Awareness user's current or past 
context. Based on information Attributes received from the characterization module. Security 
Allows some or all PIC data to be read by only intended Keys recipients. This may be optionally 
included when security issues are important to the consumer and/or the information provider. 
Internet Allows an Internet site to identify and profile a particular Cookies consumer. This 
may be optionally included by the user to facilitate repeat business or information requests. 
User .Information the user may wish to include to more fully Comments characterize their 
interests. Note that information providers may supplement their automated processes with people 
who can review PICs of interest. It should therefore not be assumed that a PIC must contain 
only machine understandable data. For instance, a PIC can be in the form of an audio file, 
which the user recorded and has the computer send to product information providers' telephony 
systems. Code Support a variety of executable code formats. For instance, information providers 
may support advanced queries using SQL, or automatic purchase mechanisms may be shared. These 
mechanisms may first be provided by the information provider, and then included in the PIC 
during subsequent purchase requests. May be used to support the convenient purchase of items 
satisfying a sufficient number of parameters in the PIC. Filters A special case of code. 
Filters aid the interpretation of interest characterizations. They can also be used by the 
information return process to restrict when search results are presented to the user. Auth- 
Allows the user to indicate how much data can be provided orizations to different classes of 
product information providers. This information can include purchase-enabling information like 
credit card numbers. This is part of a general CA permissioning scheme, that supports dynamic 
authorizations. Therefore, depending on the current context of the user, the PIC can change 
its: exposure (who sees it), content (what it contains), and validity (how well does it match 
desired goods, services, or information)'. Consumer Provides an identification of the user. This 
identification Ident- may not necessarily correspond with any legal identification, ification 
For instance, it may be unique to a particular product information provider, or class of 
product information provider. PIC Identifies what version of the PIC manager the PIC data is 
Version conforming to. PIC Securely identifies the origin of the component generating Cert- the 
PIC. ificates PIC Describes the fields included in a particular PIC, as well as Descrip- their 
purpose and use. tion Previous Provides search facilities with a history of what the Search 
consumer has already been provided, so, among other Results functions, allows the search engine 
to eliminate providing repetitive information. Weighting Characterizes what the consumer found 
interesting in previous information searches. Purchase Characterizes what the consumer had 
previously purchased. History In some cases, this information can be very detailed and so 
provide a rich product interest characterization. 

CLAIMS : 
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1. A method comprising: receiving a user search request; identifying context information for 
the user; and determining search criteria corresponding to the user search request by combining 
the user search request and the current context information. 

2. A method as recited in claim 1, further comprising performing a search of an information 
source using the search criteria . 

7. A method as recited in claim 1, further comprising: communicating the search criteria to one 
or more search components; receiving search results from at least one of the one or more search 
components; and presenting the search results to the user. 

12. A method as recited in claim 11, wherein the search criteria is to be submitted to one or 
more search components via a network, and wherein the product is to be returned to the user via 
the network. 

13. A method as recited in claim 11, wherein the search criteria is to be submitted to one or 
more search components via a network, and wherein the product is to be returned to the user via 
shipping external from the network. 

14; A method as recited in claim 1, wherein the context information comprises information 
regarding one or more of: the user's physical environment, the user's mental environment, the 
user's computing environment, and the user's data environment. 

15. A method as recited in claim 1, wherein the context information comprises information 
regarding two or more of: the user's physical environment, the user's mental environment, the 
user's computing environment, and the user's data environment. 

16. A method as recited in claim 1, wherein the context information comprises physical 
environment information pertaining to one or more of: the user's present location and the 
current time. 

20. A method as recited in claim 1, further comprising: generating a profile corresponding to 
the user; and saving the search criteria associated with the search request as corresponding to 
the profile. 

27. One or more computer-readable media as recited in claim 23, wherein the context information 
comprises information regarding one or more of: the user's physical environment, the user's 
mental environment, the user's computing environment, and the user's data environment. 

28. One or more computer-readable media as recited in claim 23, wherein the context information 
comprises physical environment information pertaining to one or more of: the user's present 
location and the current time. 

34. One or more computer-readable media as recited in claim 23, further comprising computer- 
executable instructions that, when executed, direct the computer to: communicate the search 
criteria to one or more search components; receive search results from at least one of the one 
or more search components; and present the search results to the user. 

36. A method comprising: sensing a current context of a user ; generating search criteria based 
at least in part on the current context of the user and one or more search parameters 
identified by the user; and retrieving, from one or more information sources, information 
satisfying the search criteria . 

37. A method as recited in claim 36, wherein the current context comprises information 
regarding one or more of: the user's current physical environment, the user's current mental 
environment, the user's current computing environment, and the user's current data environment. 



38. A method as recited in claim 36, wherein the current context comprises information 
regarding two or more of: the user's current physical environment, the user's current mental 
environment, the user's current computing environment, and the user's current data environment. 
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39. A method as recited in claim 36/ wherein the current context comprises physical environment 
information pertaining to one or more of: the user's present location and the current time. 

46. One or more computer-readable media as recited in claim 45, wherein the current context 
information comprises information regarding one or more of: the user's physical environment, 
the user's mental environment, the user's computing environment, and the user's data 
environment . 

47. One or more computer-readable media as recited in claim 45, wherein the current context 
information comprises physical environment information pertaining to one or more of: the user's 
present location and the current time. 

51. A method comprising: receiving a search request; identifying user-input parameters 
corresponding to the search request; identifying user context parameters, corresponding to the 
search request , that represent a context of the user ; comparing both the user-input parameters 
and the user context parameters to data describing content; and identifying content, based at 
least in part on the comparing, that matches both the user-input parameters and the user 
context parameters. 

53. A method as recited in claim 51, wherein the context of the user comprises the user's 
current context at the time of activating the search request. 

54. A method as recited in claim 51, wherein the context of the user comprises the user's 
current context at the time of generating the search request. 

56. A method as recited in claim 51, wherein the user context comprises information regarding 
multiple ones of: the user's physical environment, the user's mental environment, the user's 
computing environment, and the user's data environment. 

57. A method as recited in claim 51, wherein the user context comprises physical environment 
information pertaining to one or more of: the user's location and a time of the search request. 



58. A method as recited in claim 51, wherein the user context comprises mental environment 
information pertaining to one or more of: the user's likely intentions, the user's preferences, 
and the user's current attention. 

59. A method as recited in claim 51, wherein the user context comprises computing environment 
information pertaining to one or more of: computing capabilities of a client computer being 
used by the user, available I/O devices of the client, processing capabilities of the client, 
and available storage space on the client. 

61. A system comprising: a characterization module configured to characterize a user's context ; 
and a search criteria generator configured to generate search criteria corresponding to a user 
search request, wherein the search criteria is coupled to receive a user search request via one 
or more input devices, and further coupled to receive the user's context from the 
characterization module. 

62. A system as recited in claim 61, wherein the characterization module is configured to 
characterize the user's content based on input received from a plurality of sensors, wherein 
the plurality of sensors sense one or more of: the user's physical environment, the user's 
mental environment, the user's computing environment, and the user's data environment. 

63. A system as recited in claim 61, wherein the user's context comprises physical environment 
information pertaining to one or more of: the user's present location and the current time. 

64. A system as recited in claim 61, wherein the user's context comprises mental environment 
information pertaining to one or more of: the user's likely intentions, the user's preferences, 
and the user's current attention. 

65. A system as recited in claim 61, wherein the user's context comprises computing environment 
information pertaining to one or more of: computing capabilities of a client computer being 
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used by the user, available I/O devices of the client, processing capabilities of the client, 
and available storage space on the client. 

66. A system as recited in claim 61, wherein the user's context comprises data environment 
information pertaining to data and software resources on a client computer being used by the 
user. 

67. A system comprising: means for receiving a user search request; means, coupled to the means 
for receiving, for identifying context information for the user; and means for combining the 
user search request and the current context information to generate search criteria 
corresponding to the user search request. 

68. A system as recited in claim 67, wherein the , context information comprises information 
regarding one or more of: the user's physical environment, the user's mental environment, the 
user's computing environment, and the user's data environment. 

69. A system as recited in claim 67, further comprising: means for communicating the search 
criteria to one or more search components; means for receiving search results from at least one 
of the one or more search components; and means for presenting the search results to the user. 

Previous Doc Next Doc Go to Doctf 
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ABSTRACT: 

A method and system for filtering messages where the importance of a message is determined by 
analyzing the message body in conjunction with message attributes. Message body refers to the 
text in the body of the message, whereas message attributes convey information about the 
message. In another embodiment, analysis of the user's current computing environment provides 
additional input to the filtering system. This allows for preferentially weighting messages of 
user's current interests. Analysis includes computation of feature vectors and subsequent input 
to a discriminant function. The discriminant function provides a test statistic which is 
compared to a threshold. If the test statistic exceeds the threshold, the incoming message is 
passed by the filtering system and may be displayed to the user. In another embodiment, message 
body and attributes are used to anticipate significant events in a time series, such as 
streaming financial data. 

15 Claims, 16 Drawing figures 




http://westb^s:9000^in/gate.exe?f=TOC&state=hjj 17c. 10&ref-6&dbname=PGPB J USPT ? USOC 3 EPAB,JPA... 3/29/05 



Record List Display 

□ 11. Document ID: US 6728752 Bl 

L6: Entry 11 of 14 



File: USPT 



Page 7 of 13 

Apr 27, 2004 



US -PAT-NO : 6728752 

DOCUMENT- IDENTIFIER : US 6728752 Bl 

TITLE: System and method for information browsing using multi-modal features 
DATE-ISSUED: April 27, 2004 



INVENTOR- INFORMATION : 
NAME 

Chen; Francine R. 
Schuetze; Hinrich 
Gargi; Ullas 



CITY 

Menlo Park 
San Francisco 
Mountain View 



STATE 
CA 
CA 
CA 



ZIP CODE 



COUNTRY 



ASSIGNEE- INFORMATION: 

NAME CITY STATE ZIP CODE COUNTRY TYPE CODE 

Xerox Corporation Stamford CT 02 

APPL-NO: 09/ 421770 [ PALM] 
DATE FILED: October 19, 1999 

PARENT-CASE: 

CROSS-REFERENCE TO RELATED APPLICATIONS This Application claims the benefit of U.S. Provisional 
Application No. 60/117,462, filed on Jan. 26, 1999. This Application is also related to U.S 
application Ser. No. 09/425,038, filed on Oct. 19, 1999, now U.S. Pat. No. 6,567,797 entitled 
"SYSTEM AND METHOD FOR PROVIDING RECOMMENDATIONS BASED ON MULTI-MODAL USER CLUSTERS," U.S. 
application Ser. No. 09/421,416, filed on Oct. 19, 1999 entitled "SYSTEM AND METHOD FOR 
QUANTITATIVELY REPRESENTING DATA OBJECTS IN VECTOR SPACE," U.S. application Ser. No. 
09/421,767, filed on Oct. 19, 1999 entitled "SYSTEM AND METHOD FOR IDENTIFYING SIMILARITIES 
AMONG DATA OBJECTS IN A COLLECTION," U.S. application Ser. No. 09/425,039, filed on Oct. 19, 
1999, now U.S. Pat. No. 6,598,054 entitled "SYSTEM AND METHOD FOR CLUSTERING DATA OBJECTS IN A 
COLLECTION," and U.S. application Ser. No. 09/421,419, filed on Oct. 19, 1999, now U.S. Pat. 
No. 6,564,202 entitled "SYSTEM AND METHOD FOR VISUALLY REPRESENTING THE CONTENTS OF A MULTIPLE 
DATA OBJECT CLUSTER," all filed of even date herewith. 



INT-CL: [07] G06 F 15/16 

US-CL-ISSUED: 709/203; 707/10 
US-CL-CURRENT: 709/203; 707 /10 

FIELD-OF-SEARCH: 707/3, 707/5, 707/6, 707/9, 707/103R,. 707/100, 707/10, 709/203, 709/217, 
709/218 

PRIOR-ART-DISCLOSED : 



U.S. PATENT DOCUMENTS 



PAT-NO ISSUE-DATE PATENTEE-NAME US-CL 

5412774 May 1995 Agrawal et al . 345/804 

5442778 August 1995 Pedersen et al. 707/5 

5794178 August 1998 Caid et al . 704/9 

5893095 April 1999 Jain et al . 707/6 

5926185 July 1999 Vyncke et al. 345/619 

http://westbrs:9000ftin/gate.^ 3/29/05 



Record List Display 

5999927 December 1999 

6415282 July 2002 



Page 8 of 13 



Tukey et al. 
Mukherjea et al . 



707/5 
707/3 



ART-UNIT: 2154 

PRIMARY-EXAMINER: Maung; Zarni 



ABSTRACT : 

A system and method for browsing, retrieving, and recommending information from a collection 
uses multi-modal features of the documents in the collection, as well as an analysis of users 1 
prior browsing and retrieval behavior. The system and method are premised on various disclosed 
methods for quantitatively representing documents in a document collection as vectors in multi- 
dimensional vector spaces, quantitatively determining similarity between documents, and 
clustering documents according to those similarities. The system and method also rely on 
methods for quantitatively representing users in a user population, quantitatively determining 
similarity between users, clustering users according to those similarities, and visually 
representing clusters of users by analogy to clusters of documents. 

26 Claims, 26 Drawing figures 



□ 12. Document ID: US 6598054 B2 

L6: Entry 12 of 14 



File: USPT 



Jul 22, 2003 



US-PAT-NO: 6598054 

DOCUMENT-IDENTIFIER: US 6598054 B2 

TITLE: System and method for clustering data objects, in a collection 
DATE-ISSUED: July 22, 2003 



INVENTOR- I N FORMAT I ON : 
NAME 

Schuetze; Hinrich 
Pirolli; Peter L. 
Pitkow; James E. 
Chi; Ed H. 
Li ; Jun 



CITY 

San Francisco 
San Francisco 
Palo Alto 
Palo Alto 
Seattle 



STATE 

CA 

CA 

CA 

CA 

WA 



ZIP CODE 



COUNTRY 



ASSIGNEE-INFORMATION: 
NAME 

Xerox Corporation 



CITY 

Stamford 



STATE 
CT 



ZIP CODE 



COUNTRY 



TYPE CODE 
02 



APPL-NO: 09/ 425039 [PALM] 
DATE FILED: October 19, 1999 



PARENT-CASE : 

CROSS-REFERENCE TO RELATED APPLICATIONS This Application claims the benefit of U.S. Provisional 
Application No. 60/117,462, filed on Jan. 26, 1999. This Application is also related to U.S. 
patent application Ser. No. 09/421,770 non-final Action mailed Nov. 7, 2000 entitled "SYSTEM 
AND METHOD FOR INFORMATION BROWSING USING MULTI-MODAL FEATURES," U.S. patent application Ser. 
No. 09/425,038 Allowed (Pub) entitled "SYSTEM AND METHOD FOR PROVIDING RECOMMENDATIONS BASED ON 



http://westbrs:9000ftin/gate.exe?^ 3/29/05 



Record List Display 



Page 9 of 13 

MULTI-MODAL USER CLUSTERS, " U.S. patent application Ser. No. 09/421,416 Non-final mailed Jan. 
3, 2003 entitled "SYSTEM AND METHOD FOR QUANTITATIVELY REPRESENTING DATA OBJECTS IN VECTOR 
SPACE," U.S. patent application Ser. No. 09/421,767 Non-final mailed Nov. 3, 2003 entitled 
"SYSTEM AND METHOD FOR IDENTIFYING SIMILARITIES AMONG DATA OBJECTS IN A COLLECTION," U.S. 
patent application Ser. No. 09/425,039 Present Application "SYSTEM AND METHOD FOR CLUSTERING 
DATA OBJECTS IN A COLLECTION," and U.S. patent application Ser. No. 09/421,419 Allowed (Pub) 
Feb. 12, 2003 entitled "SYSTEM AND METHOD FOR VISUALLY REPRESENTING THE CONTENTS OF A MULTIPLE 
DATA OBJECT CLUSTER," all filed of even date herewith. 



INT-CL: [07] G06 F 17/00, G06 F 15/00 

US-CL-ISSUED: 707/103R; 707/104.1, 345/650, 345/700 
US-CL-CURRENT: 707 / 103R ; 345/650, 707 / 104.1 , 715/700 

FIELD-OF-SEARCH: 707/1-7, 707/100, 707/102-104, 707/500-501, .707/513-516, 707/526, 345/418-422, 
345/518, 345/594, 345/621-625, 345/634, 345/650, 345/654, 345/700, 345/708, 345/501, 345/530 



PRIOR-ART-DISCLOSED : 



U.S. PATENT DOCUMENTS 



PAT-NO 
5619709 
5794178 
, 6003027 
6289353 



IS SUE -DATE 
April 1997 
August 19 98 
December 1999 
September 2001 



PATENTEE-NAME 
Caid et al . 
Caid et al . 
Prager 

Hazlchurst et al. 



US-CL 

707/532 

704/9 

707/5 

707/102 



ART-UNIT: 2172 

PRIMARY-EXAMINER: Kindred; Alford 
ABSTRACT : 

A system and method for browsing, retrieving, and recommending information from a collection 
uses multi-modal features of the documents in the collection, as well as an analysis of users' 
prior browsing and retrieval behavior. The system and method are premised on various disclosed 
methods for quantitatively representing documents in a document collection as vectors in multi- 
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